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SPECIFICATION 

Electronic Version 1.2.8 
Stylesheet Version 1 .0 

METHOD AND SYSTEM FOR 
IDENTIFYING A PAPER FORM 
USING A DIGITAL PEN 

Background of Invention 

[0001] The illustrative embodiments disclosed in the present application are useful in 
systems including those for processing forms and more particularly are useful in 
systems including those for processing forms using a digital pen. 

[0002] Traditional paper based forms are used in many situations. Typically, a form will 
include pre-printed information and pre-printed boxes for data input. A salesman in 
the field or a customer in a store might fill in such a traditional form. In such a 
situation, a salesman or customer would fill in some information on the form and the 
form would be sent to a central processing location by mail or facsimile. The data on 
the form would typically be scanned or keyed in by an operator. 

[0003] In using a traditional pre-printed form, the user fills in data input spaces using an 
ink pen. The form is then sent for processing. Accordingly, the user may not be able 
to ascertain required information and may submit a partially filled in form. 

[0004] A reference entitled Apparatus and Method For Editing Electronic Documents is 

shown in United States Patent Number 5,897,648 issued April 27, 1 999 to Henderson 
and is incorporated herein by reference. The reference describes a system for 
scanning in an original document and then using a digitizing pen in conjunction with 
the scanned document. 

Summary of Invention 

[0005] 

The present application describes illustrative embodiments of systems and 
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methods for generating documents such as by completing forms. In further illustrative 
embodiments, a user utilizes a pre-printed form having a pre-printed identifier and a 
digital pen to select a form template identified by the identifier. In a further illustrative 
embodiment, the identifier identifies the particular unique copy of the form as well as 
the form type and version. 

Brief Description of Drawings 

[0006] FIG. 1 A is a schematic representation of a pre-printed form according to an 
illustrative embodiment of the present application. 

[0007] FIG. 1 B is a partial exploded view of the schematic representation of a form 

according to the illustrative embodiment of the present application shown in FIG. 1 A. 

[0008] FIG. 2 is a schematic representation of a data record according to an illustrative 
embodiment of the present application. 

[0009] FIG. 3 is a flow chart showing a process for selecting a version of a form according 
to another illustrative embodiment of the present application. 

Detailed Description 

[0010] A method and system for identifying a media is shown. In an illustrative 

embodiment, a system and method for using a digital pen to trace a pre-printed 
identifier in order to identify a form is shown. In one embodiment, a digital pen and 
pre-printed serial number is used to determine the unique instance of a form. 

[0011] 

When a user is writing on a form using a digital pen, the back end application 
must already know the type of form being used and the layout of that form in order to 
interpret the pen strokes of the user. When a traditional plain paper form was used, 
there was no information available to the digital pen to help identify and extract the 
fields of information written by the author. An author is a party that uses a digital pen 
to fill in a form. The form generator is the party that has created the form for use. A 
form template is developed to identify the layout of the form including the nature and 
location of fields used in the form that are to be filled in by an author. A serial number 
is used to identify a type of form and may also be used to identify a particular version 
of a form or a unique instance of a particular type of form. A digital pen is a pointing 
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device that can be used to input information and is preferably a wireless capable pen 
sized device that writes using ink and detects and communicates user pen stroke 
data. 

[001 2] In illustrative embodiments described herein, the application describes using a 
form identifier such as a form serial number that may be traced over and used by a 
back end application to identify a particular form being utilized. Accordingly, the back 
end application could recall a form layout in order to identify the nature and location 
of particular input fields to be used by an author. 

[001 3] Digital pointing devices such as the pen and tablet systems available from Wacom 
Technology Corp. of Vancouver, Washington allow a user to utilize a computer to 
capture pen strokes that the user traces over a tablet. Digital pointing devices may 
utilize capacitive sensors or other grid based sensors to determine absolute or relative 
position of the pointing device. 

[0014] Digital pens allow a user to capture or digitize handwriting or pen strokes that the 
user writes on a medium such as a piece of paper by using a processor such as a 
personal computer. Certain digital pens utilize an imaging device to scan or record an 
image of the pen stroke. Certain other digital pens use mechanical sensors in order to 
record a pen stroke. The pen systems may utilize positioning systems such as light- 
based scanning systems including infrared (ir) sources and detectors in order to 
determine an absolute or relative position of the pen. Digital pen systems include the 
N-Scribe system available from Digital Ink of Wellesley, MA and the E-Pen system 
available from E-Pen InMotion of Matam, Haifa Israel. A digital pointing device 
includes the V-Pen system available from OTM Technologies of Herzliya Israel. 

[001 5] Another digital pen system is the Sony-Ericsson CHA-30 Chatpen and Anoto 

paper available from Anoto AB of Sweden. The Chatpen typically utilizes a Bluetooth 
transceiver in order to communicate with a processor and the Anoto paper includes a 
grid encoding information such position information that is detected by the Chatpen. 
The pre-prmted grid may be used to identify a particular form, but using a unique 
grid for each form may be cumbersome. Additional information may be captured 
including information related to pressure, speed and pen attitude. The additional 
information includes biometric information that may be used to identify or 
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[0016] A reference describing a handheld writing device is shown in U.S. patent number 
6,050,490, issued April 18, 2000 and is incorporated herein by reference. 

[001 7] Commonly owned, co-pending U.S. patent application serial number 09/727,893 
and filed November 30, 2000 describes systems for remote retrieval of messages and 
is incorporated herein by reference. 

[001 8] Commonly owned, co-pending U.S. patent application serial number 09/707,561 , 
filed November 7, 2000 describes systems for remote retrieval of documents and is 
incorporated herein by reference. 

[001 9] Commonly owned, co-pending U.S. patent application serial number 09/728,237, 
filed November 30, 2000 describes systems for remote printing of documents and is 
incorporated herein by reference. 

[0020] Co-pending United States Patent Application Serial No. TBD, entitled Method And 
System For Creating And Sending a Facsimile Using a Digital Pen, (Attorney Docket No. 
F-521), filed on even date herewith, is incorporated by reference in its entirety. 

[0021] Co-pending United States Patent Application Serial No. TBD, entitled Method And 
System For Creating a Document Having Metadata, (Attorney Docket No. F-522), filed 
on even date herewith, is incorporated by reference in its entirety. 

[0022] Co-pending United States Patent Application Serial No. TBD, entitled Method And 
System For Identifying a Form Version, (Attorney Docket No. F-523), filed on even 
date herewith, is incorporated by reference in its entirety. 

[0023] Co-pending United States Patent Application Serial No. TBD, entitled Method And 
System For Remote Form Completion, (Attorney Docket No. F-558), filed on even date 
herewith, is incorporated by reference in its entirety. 

[0024] The Digital Pen 

[0025] The present application describes systems and methods for composing 

documents using a pointing device. Certain illustrative embodiments described herein 
utilize a digital pen that tracks an x-y position and records stroke data. A pen using 
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an infrared transceiver based positioning system is utilized and the pen tip is sensed 
to detect pen strokes. The position information and stroke information is sent to a 
processor that processes pen input. The processor (not shown) is connected to the 
pen and position sensor transceiver using a wireless connection such as Bluetooth and 
is a Pentium 4 Dell computer using Windows XP with wireless connectivity. 
Alternatively, a PDA such as a Casio PDA may be used with a wired serial interface. 
However, other sensing devices may be utilized to compose other documents, such as 
a Chatpen using Anoto paper and a pattern lookup server. 

[0026] The digital pen is utilized to capture information regarding the pen strokes made 
by a user. In the illustrative embodiments described herein, an Anoto Chatpen is 
described in order to differentiate different forms using the same underlying pattern. 
Toolkits available from Anoto AB are utilized to process stroke data and also biometric 
data including stroke data. Document generation is accomplished using Word and VBA 
available from Microsoft of Redmond, Washington. Additionally, development tools 
and customizable applications available from Microsoft may be utilized. In an 
alternative embodiment, an infrared-based digital pen is utilized. 

[0027] However, other digital pens may also be utilized. Certain digital pens utilize 

position determination in order to determine the actual location of the pen on a piece 
of paper in order to provide a relative location in terms of the location in the space of 
the piece of paper. Certain digital pens scan the ink as it is applied to digitize a stroke 
while others sense the stroke using sensors such as pressure sensors, Doppler 
sensors, accelerometers and other sensing mechanisms. 

[0028] 

The Chatpen and Anoto paper provide a pen that writes using ink on paper 
printed with an Anoto pattern. The Chatpen includes a sensor to detect the Anoto 
pattern. The detected pattern identifies the relative pen location on a grid of the 
pattern using a pattern look-up processor that may be locally or remotely located. 
The relative location allows the pen stroke and pattern look-up processor to 
determine where the pen is on a defined logical space of the pattern. Certain logically 
defined two-dimensional areas of the pattern may be defined as representing certain 
functions. For example, Anoto paper may be printed with a box that includes a 
particular portion of the pattern that is attributed the meaning of "Send Form." The 
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Anoto pattern may be utilized to determine the type of pre-printed form being 
utilized and the company that should receive the data. However, as described below, 
the Anoto pen may be used with different forms having the same underlying pattern 
by using a traceable indicator such as a form number. 

[0029] Using the Chatpen, the stroke, biometric and pattern position information is sent 
to the pen stroke processor via a wireless Bluetooth TM communications channel that 
is secure across a personal area network. A pattern lookup processor may be local to 
the document composition processor or may be remotely linked via a communications 
channel such as the Internet. Alternatively, an Intranet may be utilized in place of the 
Internet. As shown herein, a completed document or form is composed and delivered 
according to strokes made on a pre-printed form. 

[0030] The illustrative embodiments describe methods and apparatus for identifying a 
form using a traceable indicator such as a form number. Additional methods for 
identifying a form are described. The processes and apparatus described may be 
implemented using hardware, software or a combination of both. The communications 
channels may be wireless or wired and may utilize security techniques such as 
encryption. The data storage and data processors may be locally or remotely located. 

[003 1 ] The Paper Form 

[0032] Referring to FIG. 1 , an illustrative form 1 00 is used to describe an illustrative 
embodiment describing a digital pen form identification and composition service 
system. 

[0033] The Digital Pen includes a processor, memory, ink, a camera or image sensor, a 
battery and a wireless transceiver (not shown). It also includes biometric sensors (not 
shown). In an alternative, the ink is machine detectable. In another embodiment, the 
ink is invisible. 

[0034] form 100 is identified as an Auto Loan Application form 102 printed on paper. 

Section 1 1 2 provides instructions to the user so that the user will know to trace over 
the form number 1 10 using the digital pen. In this embodiment, the form number 
must be located in that location for every form that is processed by the back end 
application (not shown). In an alternative, the form recognition system may continue 
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to process and store pen strokes without knowing the underlying form type until the 
back end application recognizes the trace over for a form serial number. 

[0035] The form 1 00 includes an Applicant Name field 1 1 4, an Address field 1 1 8, a Social 
Security Number field 11 6, a state field 1 22 and a zip code 1 20. 

[0036] The form also includes a signature box 1 26 having indicator 1 06 and a date input 
field 124 having an indicator 104. 

[0037] In one embodiment, the digital pen is a Chatpen using a Bluetooth TM transceiver. 
Bluetooth TM utilizes several layers of security. At a link level, remote/local device 
authentication is required before any communication can take place. At the Channel 
level, a link level connection occurs and then the devices need to authenticate before a 
communications channel is established. Additionally, the data payload being 
transmitted may be encrypted. In this embodiment, appropriate security at several 
protocol layers is utilized including the application layer. 

[0038] In an alternative, the pen includes audio input/output including synthesized voice 
output and voice recognition. Visual output is provided using an LCD display and LEDs 
and tactile feedback is provided using servomechanisms. Physical input includes an 
input button. 

[0039] The connections between the pen (not shown) and the processor (not shown) 

could be over private lines or may be a Virtual Private Network. It is contemplated that 
all of the connections utilize appropriate security measures. 

[0040] Other well-known input devices, servers, processors, networks and 

communications mechanisms may be used. The back-end application (not shown) is 
utilized to process pen strokes. The back end application then recognizes form 
identification strokes in box 1 1 0 to identify the form so that it can attribute the other 
strokes with the particular form template. In an alternative, pen strokes are stored 
until the form is identified. 

[0041] The data written by a user in a particular data input flied can be rasterized and 
then subjected to Optical character recognition (OCR) in order to identify the data 
written by the user. 
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[0042] The present embodiment may alternatively use any pen or stylus like device that 
provides for electronically recording strokes. Position information may be processed 
into strokes or transmitted in a separate data stream. 

[0043] . Here, the digital pen system utilizes a pen and system that can continuously track 
the movement and location of the pen and record pen stroke data. Some pen stroke 
data may be buffered in the pen before the data is sent to the back end application. 
The pen system can wirelessly transmit or store and transmit tracking data in the pen 
stroke data. The digital pen can submit the form to the back end application as a 
transaction. The form generator includes a form serial number on the paper form 
being distributed for use by the authors. Each form type has a different serial number 
that is preferably pre-printed on the form using a traceable font having dashed lines 
as shown in 110. When the user traces the form serial number, the back end 
application receives the information and recalls a form template and other data in 
order to process the pen strokes. 

[0044] Referring to FIG. 1 B, a exploded view of a portion of form 1 00 is shown. In this 
embodiment, the form number 1 1 0 is located in box 1 1 1 and is printed in a dashed 
outline font. A user will then be able to trace over the characters and know what 
characters have been traced over by determining which have been filled in. 

[0045] Referring to FIG. 2, a schematic representation of a data structure stored by the 
back end application on the processor (not shown) is described. Here, the preprinted 
form 1 00 has several field names such as the serial number 1 1 0 that is associated 
with the data structure 200 as serial number 210 having a field type 222 and a field 
location 224 that defined the two dimensional space on the form dedicated to that 
field. The data structure has columns including the field name 210, field type 212 that 
defines a data type and field location 214 that defines a two dimensional space for the 
item on the form. The serial number has associated fields 220, 222, 224. The 
Applicant name is associated with fields 230, 232, 234. The Address is associated 
with fields 240, 242, 244. The City is associated with fields 250, 252, 254. The Zip 
Code is associated with fields 260, 262, 264. The Social security number is associated 
with fields 270, 272, 274. The Applicant signature is associated with fields 280, 282, 
284. The Date is associated with fields 290, 292, 294. 



APP ID-1 0065285 



Page 8 of 18 



.1 III O ft S 2 » S , O * 1 3 O O EH! 



[0046] The form generator will generate the form template when creating the form and 
will associate the template and related data with a particular form serial number. The 
serial number form can be placed anywhere on the form when it is created, but it is 
preferably placed near the top of the form. In some uses of the system, the serial 
number is traced first. However, the pen or back end system could store stroke data 
until the form serial number is parsed and then process the stroke data in accordance 
with the recalled template. The form template is preferable used to generate and print 
the copies of the form that are to be used. The forms may be made available in the 
form of a computer file that can be printed and then used with a digital pen. 

[0047] Supplemental text 1 1 2 instructs the user in tracing the serial number 1 1 0 on the 
form 100. The digital pen may transmit pen stroke data to the back end application 
while it is being written. Alternatively, the part or all of the transaction of filling in the 
form may be stored in a buffer in the digital pen and later transmitted to the back end 
application for processing. 

[0048] The back end process may then process the completed form as a transaction. The 
back end process can then locate the serial number field in the data and extract the 
serial number using a character recognition technique such as Optical Character 
Recognition (OCR). In this scenario, the back end application need not detect the 
characters of all of the stroke data and may use the template to apply the strokes as 
graphical information rather than live detected text. In an alternative, all or some of 
the rest of the stroke data may be recognized using an OCR algorithm. 

[0049] 

In an example using a serial number that is not placed in a particular location of 
the form, the serial number may be pre-printed using a particular font in a traceable 
format that the back end process is programmed to detect. Similarly, a specific 
number of characters may be assigned to the serial number or a control string of 
characters could be used that is not likely to appear in a normally filled in form. 
Additionally, non-alphanumeric characters such as special characters or symbols may 
be used to enable the back end application to recognize the unique form indicator or 
serial number. In such situations, the back end application could scan all of the stroke 
data or some data that meets certain font or other guidelines while comparing that 
detected text to a lookup table of valid serial numbers in order to properly associate a 
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template to the formReferring to FIG. 3, a process for identifying a form template is 
described. The process beings in step 305 and the form processor receives and stores 
pen stroke input data in step 3 10. Here, the pen stroke data may be a data feed in the 
wireless channel or data sent from a paired device such as a cellular phone that stores 
some stroke data and then communicates it through the Internet to a form processor. 
In step 320, the form process 300 determines if the form type serial number has been 
determined. If the form is not identified, the process returns to step 310 to receive 
additional pen stroke data. If the form is identified, the process proceeds to step 330 
to parse the input and any commands and data as expected from the form template. 
The process 300 continues to process the form data in step 340 until the process is 
completed in step 399. The back end application may check for an end of form 
indication such as the use of the signature block or the lapse of a certain period of 
time in the user input stream. 

[0050] Known systems such as C++ or Word and VBA may be utilized for a back end 

application. The Anoto toolkit may be utilized. The authentication data may be used to 
ensure that only authorized users have access to the forms and data. 

[005 1 ] In an alternative applicable to any of the embodiments described, the form 

processor can use the pen stroke data and pen identification data to determine if the 
salesman or user has authority to use the particular form. 

[0052] In any of the described embodiments, error indications or messages may be 
communicated using LED indicators, a display such as an LCD display or audio 
indications such as beeps or synthesized speech using a speaker. Additionally, tactile 
feedback may be utilized to indicate an error condition or provide other feedback such 
as an indication that a form was successfully identified and completed. 

[0053] The preserlt application describes illustrative embodiments of a system and 

method for composing documents using a pointing device and in one embodiment 
describes a digital pen system for detecting a form version using a digital pen. The 
embodiments are illustrative and not intended to present an exhaustive list of 
possible configurations. Where alternative elements are described, they are 
understood to fully describe alternative embodiments without repeating common 
elements whether or not expressly stated to so relate. Similarly, alternatives described 
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for elements used in more than one embodiment are understood to describe 
alternative embodiments for each of the described embodiments having that element. 

[0054] The described embodiments are illustrative and the above description may 
indicate to those skilled in the art additional ways in which the principles of this 
invention may be used without departing from the spirit of the invention. Accordingly, 
the scope of each of the claims is not to be limited by the particular embodiments 
described. 
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